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SUMMARY 

The  problem  of  estimating  the  order,  (p,q),  of  an  ARMA  (p,q) 
process  is  considered.  An  extension  of  the  Gray,  Kelley,  and 
Mclntire  (1978)  method  of  estimating  (p,q)  is  proposed  and  shown 
to  be  particularly  useful  for  processes  whose  spectra  have  a 
certain  form.  Simulated  data  is  used  to  illustrate  the  use¬ 
fulness  of  the  extension. 

1.  Introduction  and  Definitions 

Gray,  Kelley,  and  Mclntire  (1978)  have  illustrated  how  a 

certain  transform,  S  (•),  of  the  autocorrelation  function  mav 
n 

be  used  to  estimate  p  and  q  from  a  realization  of  an  ARMA(p,q) 
process.  Their  technique  hinges  on  the  following  two  facts. 

If  is  the  autocorrelation  function  of  an  ARMA(p,q) 
process,  then 


\  ■  Vk-i 


. .  -  ♦  p. 

p  fc-p 


0  for  k  >  q  . 


(1) 


Under  quite  general  conditions  on  the  real 


(2) 


sequence  { f  k>  , 

S  (f  )  *  C  for  m  >  mn  iff  {f_}  e  L(n,A)  for  a  >  a-, 
an  —  u  m  u 

These  two  facts  Imply  that  p  and  q  can  always  be  determined  if 

the  autocorrelation  sequence  of  the  process  is  known.  This 

Important  "consistency”  property  is  not  possessed  by  the  popular 

Box- Jenkins  (1976)  aethod  in  the  case  of  the  mixed  process  (i.e. 

p  >  0  and  q  >  0) . 

The  Gray,  et  al  method  of  estimating  p  and  q  Involves 
the  examination  of  an  array,  known  as  the  S-array,  which  contains 

A 

values  of  S  (p, ) ,  where  usually 
n  k  N-k 

Z  (X  -X) (X  , -X) 

:  f  i 

°k  “  N  _  , 

z  (x„  -  xr 

t-1  t 

A  constancy  pattern  in  the  S-array  consistent  with  (2)  leads 
to  estimates  of  p  and  q.  Numerous  simulation  studies  and  use 
of  the  S-array  method  on  real  data  have  indicated  that  this 
constancy  pattern  is  sometimes  more  apparent  in  an  array  based 
on  S  t(-l)kp,  ].  Since  {p.  >  e  Up, A)  for  k  >  q  if  and  only  if 
{(-l)kpfc}  e  Up, A)  for  k  >  q,  the  same  theoretical  justification 

<  A  * 

exists  for  using  SQ[(-1)  Pkl  to  estimate  p  and  q  as  for  SQ(pk> . 

The  differing  statistical  properties  of  these  two  transforms 


will  be  discussed  later. 

If 

S  (p,  )  and  S  [(-1)  p.  ]  are  members  of  the  following  class 
n  k  n  k 


of  transforms  of  p^: 

(Sn(.2rt“\)  = 


0  <  a)  < 


The  properties  of  these  transforms  when  is  the  autocorrelation 
function  of  an  A8MA(p,q)  process,  and  the  estimation  of  p  and  q 
by  means  of  S  (e2iriu>ltp.  ) ,  are  the  subject  of  the  remainder  of 
this  paper. 
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Before  proceeding  to  the  next  section,  the  following 
definitions  and  notation  are  given. 

A  stochastic  process  {XtK  t  *  0,  +  1,  +2,...,  is  said  to 
be  autoregressive  of  order  p  and  moving  average  of  order  q,  or 


AHMA(p.q),  if 
P 


Xt  "  Z  *kXt-k  +  Zt  “  E  9kZt-k  for  ail  C* 
c  k-1  *  t  *  c  k«l  *  c  * 


where  the  and  9^  are  constants  and  {Zt>  is  a  white  noise  process 
with  finite  variance.  If  the  operator  B  is  defined  by  BXt  * 
then  the  above  may  be  written  as 

$(B)Xt  *  9(B) Zt>  where 

d>(B)  -  1  -  $jB  -  $2B2  -  ...  -  <t,pBp 


and 


9(B)  -  1  -  0,B  -  9,B2  -  ...  -  9  Bq 
1  Z  q 


It  is  well  known  that  (Xt>  is  stationary  if  and  only  if 
all  of  the  roots  of  tp(x)  -0  He  outside  the  unit  circle. 

Let  m  be  an  Integer  and  f  be  a  complex-valued  function  of 


a  real  variable.  Further,  let  f  ■  f(m), 

m 


H  (f  )  - 

n  a 


W1*  V  - 


^m-n+l 

fm-n+2  ' ’ ’ 

f 

m 

^m-n+2 

fm-n+3  ' ’ * 

fnr+l 

• 

f 

m 

fm+l 

fnt+n-l 

1 

1 

1 

^m-n+1 

• 

fm-n+2  *'* 

• 

fm+l 

• 

• 

• 

f 

m 

• 

fm+l 

• 

fm+n-l 

V  _  _  . 


t 

i 


where  n  Is  a  positive  Integer.  Now  define 


. ,, ,  W1'  V 

VV  a  It ) 

n  m 


and 


W 


iju  - 

n  n 


*  n  ■  2,3, . 


n  -  1 


The  S-array  for  the  function  f  Is  the  following  array  of  complex 
numbers: 


m/n 

1 

2 

e  e  • 

k 

• 

• 

e 

-j 

e 

• 

• 

e 

w 

• 

e 

• 

e 

w 

« 

see 

e 

• 

e 

w 

e 

e 

9 

-2 

9 

Sl<£-2> 

S2(f-2> 

•  e  e 

• 

VW 

-1 

Vf-1> 

*2(,-l> 

9  9  9 

V'-i> 

0 

s1(fQ) 

w 

*99 

W 

1 

W 

S2(fl> 

see 

w 

2 

• 

Sl(f2) 

e 

w 

9 

•  •  e 

w 

9 

• 

j 

• 

W 

e 

vv 

e 

9  9  9 

yv 

e  | 

e 

e 

9 

e 

• 

• 

e 

The  following  recursion  relations,  due  to  Pye  and  Atchison  (1973) 
are  quite  helpful  in  calculating  S-arrays.  If  SQ(fm)  is  defined 
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where  n  =  1,2,...,  and  m  is  any  integer. 

A  complex-valued  sequence  {£  }  will  be  said  to  be  an 

ra 

element  of  L(n,A)  for  m  >  ra^  if  there  exists  a  smallest  integer 

n  >  0  and  a  set  of  c^'s  such  that 

f.  +  c,f,  ,  +  ...+  c  f,  ■  0,  m  >  m„  . 
k  1  k-1  n  k-n  0 

2.  Properties  of  S  (e2*^^  ) 


Theorem  1  is  now  stated  in  order  to  given  an  explicit 
form  for  each  of  the  transforms  in  {S  (e2**"10'^) 5  0  £  w  ±  y). 

Theorem  1  .  Let  {a^:  k*0,  +  1,...}  be  any  sequence  of  real  or 
complex  numbers.  Then  for  any  positive  integer  and  any 
integer  k^,  we  have 


S  <e2iri“V  )  *  e2iri<un0 
n0  0 


Proof:  By  definition 


S  (.2.1.10  )  . 


0  0 


- 2niu> 

e 

...  e~2iritfn0 

ak.-n.+2 

0  0 

...  akQ+l 

Vv3 

...  \+2 
• 

V1 

• 

• 

\*a0 

<ak  ) 

Ko 

\  1 

Ko 

0  H  («2"I“'‘<V  ) 
”o  0 


e2irlU(k0-t,0+1) 

*(fno+1 

2tt1w  (kg-ng+2) 

^0“V2 

... 

K| 

e2ilU(k0-V2) 

K0  0 

^ir^kg-n +3) 

VV 3 

... 

Kl 

• 

• 

• 

2irlwkn 
e  Oa. 

K0 

• 

• 

+1 

Ko  1 

2iriu(k_+nn) 
...  e  0  0  a. 

exp{2iriu[aQ(ng-l)/2]}  * 

1 

1 

1 

2iriw(ka-n_+l) 

e  0  0  Vv1 

t!,wVv!)Vv! 

2iria»(k+l) 

•  «  *  C  ^  j 

V 

2itiu  (kn-nQ+l) 

e  0  0  Vv2 

•!'ww!)Vvl 

• 

2iriu  (kft+l) 

. . .  e  0  a.  , 

Ko 

• 

• 

• 

• 

#2irl(J  (kg-tlg+1) 

*0 

• 

• 

2nlu(kn-nn+2) 

e  0  0  \+l 

• 

• 

...  . 
“■0 

1 

-2iri id 

e  •  •  • 

-2irtomr. 
e  0 

■  #2fflun0(k0+l)  «v  - 

n«+l  \  -n„+2 

a,. 

The  above  follows  from  simple  row  and  column  operations.  A 

similar  set  of  operations  yields 

„  ,  2iritokn  .  liriwn-k,.,.  ,  s 

H  (e  Oa,  )  *  e  0  OH  (a.  )  , 

«0  'cg  ng 

and  the  result  follows. 

From  Theorem  1  we  see  that  S  (e^^^a^  depends  on  k  only 

through  the  sequence  {a  }.  This  fact  will  be  helpful  later  when 

m 

we  consider  {a  }  *  {p  }. 

m  m 

As  noted  previously,  the  autocorrelation  function  of  an 
ARMA(p,q)  process  satisfies  the  following  relationship: 

pk  -  Vk-r  *** "  Vk-P "  °» k  >  q* 


This  relationship,  however,  is  equivalent  to 

2iriwkr  .  ,  .  .  , 

e  ^pk"^lpk-l~* * *-<*kPk-p  "  k  S  q 


or 


k  >  q. 


In  other  words,  for  k  >  q,  fk(w)  -  e2iri“k  is  the  solution  of  a 
pth  order,  homogeneous  difference  equation  with  complex  constant 
coefficients.  If  (2)  holds  for  complex  sequences,  then  fk(u>) eL(p,A) 
fork  >  q  allows  the  complex-valued  transforms  ,  0<io<-|  , 

to  be  candidates  for  use  in  the  estimation  of  p  and  q.  The  validity 
of  (2)  for  complex  sequences  is  established  in  the  following 
theorem. 

Theorem  2  Let  (fk)  be  a  sequence  of  complex  numbers.  Suppose 

S  (f  )  and  R  (f  )  are  defined  and  Is  (f  )|  >  0  for  m  >  m_. 
nQ  m  n0  m  n0  m  ~  0 
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Then 


f  c  L(n„,A)  for  m  >  m_  iff 
mu  u 

S  (f  )  *  C  for  m  >  m„. 
n0  °  “  0 
no 

Further  C  =  (-1)  (l-a.-a,,-. .  .-a  )  where 

1  ^  nn 


f 

m 


alfm-l 


n_  m-n„ 


0,  m  >  mg  . 


Proof:  The  proof  of  this  theorem  by  Gray,  Houston,  and  Morgan 

(1978)  for  real  {f^}  depends  only  upon  properties  of  determinants 
and  systems  of  linear  equations.  These  properties  hold  so  long 
as  the  elements  of  {f^>  belong  to  a  field.  Since  the  complex 
number  system  satisfies  the  field  properties,  the  result  follows. 

The  basis  for  the  remainder  of  this  work  is  established 
in  Corollary  1  and  Theorem  3 . 


Corollary  1.  Suppose  the  time  series  (Xc:  t  •  0,+l,...}  is  a 

stationary  ARMA(p,q)  process  with  autocorrelation  pffl.  Suppose 

S  (f  (o>))  and  R  (f  (w))  are  defined,  p  >  0  and  |S  (f  (tu))|  >  0. 
“0  *  n0  m  n0  m 
Then  for  some  integer  m^ 


S„  "  ci  M  and 

nQ  m  l,(u  —  u 


S„  (fm  *  C1  m 

no  mo  1 


if  and  only  if  nn 


p  and  mg  ■  q.  In  addition 

_2iri x  x  2iri<i)p 


'1,“ 


(-1)*U  -  ^e  -^2e 


-v 


). 


Proof:  Since  (f  («)}  e  L(p,A)  and  satisfies  the  equation 
hl 

fI(.)-(41.!"")V1(«)  -  ...  -  ‘  0,  .  >  q. 

the  results  follow  immediately  from  Theorem  2. 
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Theorem  3  below  is  the  analog  of  Theorem  3  in  Gray,  Kelley, 
and  Mclntire  (1978) .  Its  validity  follows  from  the  fact  that, 
since  p^  *  p^,  we  have 

p-k  -  V-k+1  -  -  V-k+p  "k  <  “9* 


Theorem  3  Under  the  conditions  of  Theorem  2 


S  (f  (w))  »  C-  ,  m  <  m.  and 

Bq  ■  <£,«*)  —  l 

Sn(fm  +1(M))  *  C2 


iff  n„  »  p 


'2,ca 


and  o,  ■  -q-1.  In  addition, 
2iriu»p 


Proof:  The  proof  is  completely  analogous  to  the  proof  of 

Theorem  3  in  Gray,  Kelley,  and  Mclntire  (1978).  Only  trivial 

modifications  are  required  to  adjust  for  the  fact  that  S  (f  (uj)) 

n  m 

is  complex-valued. 


Corollary  1  and  Theorem  3  show  that  there  is  no 

inherent  reason  for  considering  only  the  real  valued  transforms 
«  k" 

S  (p,)  and  S  [(-1)  p,  ]  in  the  estimation  of  p  and  q.  The  question 
n  K  n  k 

remains,  however,  as  to  which  transform  from  the  class  {S  (e2lflukp, ) : 

n  k 

0  <  u  <  ^}  is  (in  some  sense)  best  for  estimating  p  and  q.  The 
best  transform  must  obviously  depend  on  the  nature  of  the  process 
being  observed,  and  thus  some  method  is  required  to  identify  this 
transform  for  a  given  process.  One  immediate  clue  towards  the 
solution  of  this  problem  comes  from  Corollary  1,  which  shows 
that 

S  (f  '(«•))  -  (-l)P(l-«1e2iri“-...-doe2lTlwp),  m  >  q.  (3) 

p  O  i  p 


- - —  - ^ 


A 


Since  Che  spectrum,  sx(*)»  of  an  ASHA.  (p,q)  process  is  such  that 


ax(“) 


|1  -  Sj® 


2iriw 


h  .  .2irito 
1 1  -  ♦le  -  ...  -  ip  e 

P 


-  e  e2lri“q|2  • 

_ a 


2iria»p  j  2  —  2  ^  * 


it  follows  that  for  m  >  q,  S  (f  (w))  is  closely  related  to 

—  p  a 

sx(<»») .  In  fact,  if  q  ■  0,  we  have 


sx(<ii)  * 


1 _ 


m  >_  q. 


This  relationship  will  be  exploited  in  the  next  section  when 
the  problem  of  choosing  an  optimal  transform  Sn(e2ir*U0kpk>  is 
formulated. 


3  Formulation  of  the  Optimal  Frequency  Problem 

Estimating  p  and  q  by  the  S-array  method  involves  examining 
an  array  for  the  presence  of  a  certain  constancy  pattern.  The 

A  A 

data  at  hand  supports  the  estimates  p  and  q  if 
S“(e2lTiu^p^)  -  Cj,  k  >  q  and 
S“(e*  pk)  *  c2,  k  <  -q  -  1  . 

For  a  given  process,  the  transform  to  be  used  to  estimate  p  and 
q  should  be  the  one  which,  on  the  average,  makes  the  correct 
constancy  pattern  the  most  apparent.  The  ability  of  S  (e2lflwkpk) 
to  evidence  this  constancy  depends  on  two  things: 

(i)  the  variability  of  Sp(e2iri“kpk>  for  k  >  q  and  k  <  -q-1, 

and 

(li)  the  magnitude  of  the  two  constants  being  estimated  by 
Sp(e  Pk)  for  k  _>  q  and  k  _<  -q  -  1. 

These  considerations  lead  to  the  following  definition. 


Definition  1  Suppose  {X£}  i3  a  stationary  AKMA  (p,q)  process. 
Then  the  frequency  will  be  referred  to  as  optimal  for  the  esti¬ 
mation  of  p  and  q  iff 


var[S  (e2*1^  )] 

_ E _ 9_ 


<  var-  P 


[S,.(e2Ti“qp~q)3 


ll-^e 


2iri  uq_ 


2iriu)op|2 


ll-^^ 


2xiu) 


2’rioip  1 2 


for  all  ue  [0,  . 

In  light  of  (3),  our  definition  of  the  optimal  frequency  is 

consistent  with  (i)  and  (ii)  above,  although  we  consider  the 

variance  of  only  positive  lag  S-array  values.  Note  that  the 

quantity  considered  in  the  definition  is  essentially  the 

squared  coefficient  of  variation  of  the  random  variable 

s  U2irljo<  ). 

p  q 

In  order  to  obtain  an  expression  for  var[S  (e2lTiuqp  )], 

P  9 

recall  that,  by  Theorem  1 


S  (e2iriuqo  )  -  a2irii*)p 

p  q 


e 

q-p+i 

P  q-p+2 

q-p+2 

Pq-p+3 

e-2Triwp 

°q+l 

P  J.O 
q+2 


h_Cp  ) 

p  q 


By  performing  appropriate  row  and  column  operations  and  expanding 
the  numerator  by  cofactors  of  the  first  row,  we  have 


S  (e2*1^  )  -  (-l)p(l-i1(p'<l)e2l,la,-...4(p*<l)e2,ri“‘p) 

p  q  1  p  ' 

where  ($.<p,q),  ^>^P,q) . $(p,ql)  is  the  solution  of 

12  p 


»  « 

•  n 

Pq  Pq-1  **•  Pq-p+l 

°q+i 

Pq+1  Pq  •••  °q-p+2 

Pq+2 

•  •  • 

•  •  • 

i  - 

; 

A  A  A 

P  P  .  .  •  P 

q+p-1  q+p-2  q 

L  j 

Pq+p 

■  ■ 

By  the  definition  of  variance  of  a  complex  valued  random  variable 
(i.e.,  var(X  +  iY)  -  var(X)  +  var(Y))we  thus  have 

var[S  (e2fflwqp  )]  -  I  var(d/P,q^)[cos22iro)k  +  sin22iruk] 

P  q  k-1  k 


+  2  ZZ  {(cos2iro)jcos2iraik  +  sin2ira)jsin2v(ok) 

x  cov(^p,q),  ^p,q))> 

-  ?  var(^p,q)) 
k-1 


+  2  SIcos[2Tro>(k-j)Jcov(i5P’q)>  $5P,q)) 

j<k  i  * 


p-k 


p-1 

■  +  2  E  di,  cos2nwk 

0  k-1  k 


(A) 


where  <|>k  -  E^cov($jP,q^ ,  $jP£q^),  (k  -  0,1, . . .  ,p-l) . 

Therefore,  the  frequency  which  is  optimal  for  the 
estimation  of  p  and  q  is  the  value  of  a >  which  minimizes 


l  ■ 
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C(u>) 


P-1 

+  2  E  cos2ir<i)k 

|l-*, e2lTi“-...-*  e27fi“P|2 
1  P 


(5) 


Interestingly,  the  above  expression  shows  that  our  criterion  for 
identifying  is  essentially  equivalent  to  the  problem  of  finding 
the  frequency  at  which  the  spectrum  of  an  ARMA  (p,p-l)  process 
has  its  minimum. 

The  above  considerations  illustrate  that  for  many  processes 
there  exists  “q  ^  °»  \  for  which  S  is  optimal  for  the 

estimation  of  p  and  q.  We  have  not,  however,  addressed  the  pro¬ 
blem  of  identifying  <0q  given  a  record  of  finite  length  from  an 
ARMA  process.  A  less  than  optimal,  but  useful,  solution  to  this 
problem  will  be  discussed  in  the  next  section. 


4.  Estimating  the  Optimal  Frequency  uiQ 

The  dependence  of  (  5  )  upon  p  makes  the  estimation  of 
difficult.  Suppose  for  the  moment,  however,  that  for  the  process 
under  consideration  q  ■  0.  Then  the  quantity  C(w)  is  proportional 
to 

P-1 

C*(io)  -  s  (u)(iJ/n+2  I  i|>,  cos2iruk) . 
x  U  k-1 


Experience  has  shown  that  for  most  processes  the  minimum  of  C*(o>) 

occurs  at  about  the  same  frequency  as  does  the  minimum  of  s  (u)  . 

P-1  X 

This  is  because  <ji.  +  2  I  tp.  cos2  iroik  is  almost  flat  in  relation  to 
u  k«l  K 

s^Cw).  Stated  another  way,  if  {S  (e^^kp^)}  is  viewed  as  a 
stochastic  process  with 

Sp(e2^k)  -  Sp(e2*i(1\)  +  ep>k(m), 
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The  approximation  of  £n(NC(u))  uses  the  Box  and  Jenkins  (1976) 
approximation  for  the  variance-covariance  matrix  of 

±'  -  <;£p’o),  ;<p*o) . ;jp*o)). 

Assuming  that  the  noise  process  (at)  is  composed  of  independent 

2 

and  identically  distributed  N(0,o  )  random  variables,  it  can  be 


shown  that 


where 


var(£)  »  ^(1  - 


m  (p^tP2»  •  •  •  »P-) »  “  ^1*^2’  ’  ’  *  * 


and  N  is  the  sample  size. 

The  processes  associated  with  Figures  1  and  2  are. 


respectively 
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(l-.60B)(l-1.0607B+.5625B2)(l+.4944B+.64B2)Xt  -  Z£  (6) 

and 

(1-.95B) (1+.95B) (1-1.3435B+.9025B2)X^  -  Z’.  (7> 

As  was  conjectured,  &n( NC(ai))  and  -Zin<\  l-$je2lT*M-. .  .-d^e2wiap| ) 
are  minimized  at  the  same  value  of  u  for  process  (6)  and  at 
approximately  the  same  value  for  process  (7). 

The  above  considerations  suggest  that,  for  autoregressive 
processes,  a  reasonable  estimate  of  would  be  the  value  for 

which  a  window  spectral  estimate  s^Coi)  is  minimum.  It  should  be 
pointed  out,  though,  that  since  oi^  is  of  interest  only  because 
of  its  utility  in  estimating  p  and  q,  it  is  actually  not 
important  to  have  a  precise  estimate  of  this  parameter.  If  the 
array  associated  with  Wq  indicates  obvious  estimates  of  p  and  q, 
then  u>0  has  performed  its  intended  function. 

The  purpose  of  our  discussion  to  this  point  has  been 
twofold: 

(i)  to  illustrate  theoretically  the  possible  value 
of  complex-valued  S-arrays  in  the  estimation 
of  p  and  q 

(ii)  to  address  the  problem  of  estimating  a  frequency 
Uq  for  which  SQ(e2iria)Okok)  is  optimal  for  the 
estimation  of  p  and  q. 

Still  open  for  research  is  a  complete  solution  to  the  problem 
in  (ii) .  For  the  present,  however,  it  is  suggested  to  Initially 
examine  the  S-array  associated  with  unless  occurs  at  a 
sharp  dip  in  the  estimate  of  the  spectrum.  Such  a  sharp  dip 


is  evidence  of  a  near  noninvertible  moving  average  factor,  and 
thus  is  not  Indicative  of  a  small  value  of 


e2riup|2 


1  - 


♦le 


2irlu 


If  <i>Q  occurs  at  a  sharp  dip,  then  the  S-array  associated  with 
the  next  smallest  local  minimum  should  be  examined  Initially. 
Additional  S-arrays  may  be  examined  if  estimates  for  p  and  q 
are  not  apparent  in  the  first  array.  Such  an  examination  of 
several  different  arrays  may  seem  prohibitive  in  terms  of 
computing  time,  but  this  is  actually  not  the  case  due  to  the 
recursive  algorithm  defined  in  Section  1. 


5.  Examples 

The  results  of  Section  4  imply  that  S-arrays  based  on 
frequencies  satisfying  0  <  u  <  will  be  the  most  valuable  for 
processes  whose  spectra  have  relatively  large  power  at  w  *  0 
and  m  •  -j.  Therefore,  since  the  purpose  of  this  section  is 
to  illustrate  the  practical  importance  of  complex-valued  S-arrays, 
the  two  examples  which  follow  will  involve  such  processes. 

In  each  of  the  two  examples  to  be  considered,  five  indepen¬ 
dent  realizations  of  an  autoregressive  process  were  generated. 

The  process  in  Example  1  (whose  log- spectrum  appears  in  Figure 
3)  is 

(1  -  .95B) (1  +  .95B)Xt  -  Zt  ,  (8) 

and  the  process  in  Example  2  is  process  (7) .  Realizations  of 
length  ■  75  and  Nj  -  50,  respectively,  were  generated  from 


(8)  and  (7).  In  each  case  the  values  of  the  noise  process 


{Zt>  were  obtained  by  generating  random  samples  from  the  N(0,1) 
distribution  using  IMSL  subroutine  GGNPM. 

For  each  of  the  ten  realizations  an  estimate  of  the 
spectrum  was  calculated.  The  estimates  In  each  case  utilized 
a  Parzen  window  based  in  Examples  1  and  2,  respectively,  on  11 
a&4  8  values  of  the  estimated  autocorrelation  function.  The 


following  empirical  measures  of  constancy  in  the  S-array  were 


tviaa  computed  for  each  realization  In  Example  j : 

l^i-  r  2iritnk.  -  .  .  1 2 

c  ^  (Pi.®  )  *  S  ((a))  I 

Vo  pi  k  p< 


'!«■> 


where 


p.  -  2,  p  -  4,  Cui)  -  |  2  S  (p.  e2iri,1,k) , 
1  2  Pj  6k-0  Pj  k 


and  u  «  0,  and  the  frequency  at  which  the  estimated 
spectrum  Is  minimized.  Note  that  c^ (u>)  Is  a  sample  analog  of 
the  quantity  C(u) . 

Table  1  contains  the  average  value  of  c^(0),  c^(-|), 

and  Cj(uq)  over  the  five  realizations  of  Example  j  (j  ■  1,2). 

In  addition.  Tables  2  and  3  show  the  S-arrays  associated 
1 

with  “  •  0,  y,  and  for  typical  realizations  in  the  two 
examples. 


In  each  example,  the  average  value  of  c^  (nig)  Is  seen  to 
be  smaller  than  the  average  of  either  c^ (0)  or  c^ (y) ,  and 

A 

further,  c^ («q)  was  the  smallest  of  the  three  values  for  all 
five  realizations  In  both  examples.  The  numerical  evidence 
in  Table  1  favoring  S-arrays  based  on  u)Q  is  presented  visually 


r 
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TABLE  1 

AVERAGE  VALUES  OF  c^(u>)  and  c2(u) 
IN  EXAMPLES  1  AND  2 


j 

c^O) 

c1(u0) 

c^.5) 

1 

.0878126 

.0005025 

.0361297 

2 

3.1317649 

.1238482 

.2255245 

1 


in  Tables  2  and  3.  Although  constancy  is  apparent  in  all 
three  arrays  in  both  examples,  it  is  most  apparent  (for 


Example  j)  in  the  array  based  on  cd^  due  to  the  magnitude  of 
the  quantities  being  estimated  in  column  p  . 


6.  Summary 


A  refinement  of  the  S-array  method  of  modeling  ARMA 
processes  has  been  Introduced  in  this  chapter.  In  so  doing, 
the  theory  of  complex-valued  S-arrays  was  developed,  and  the 
problem  of  identifying  a  frequency  whose  associated  S-array 
is  optimal  for  estimating  the  order  of  an  AHMA  process  was 
formulated.  Additionally,  two  examples  Involving  simulated 
data  were  considered  in  which  S-arrays  based  on  estimated 
optimal  frequencies  gave  clearer  determinations  of  the  order 
of  the  underlying  processes  than  did  real-valued  S-arrays. 

The  true  usefulness  of  the  method  discussed  in  this 
chapter  cannot  be  ascertained  until  it  has  been  utilized  on 
real  data.  Constancy  patterns  in  the  S-arrays  of  simulated 
data  tend  to  appear  quite  good  at  all  frequencies,  and  thus 
the  potential  worth  of  complex-valued  S-arrays  may  have  been 
understated  in  the  examples  of  the  previous  section.  The 
possibility  exists  that  for  certain  data,  constancy  which  is 
virtually  hidden  in  the  two  real-valued  S-arrays  is  readily 
apparent  in  some  complex-valued  array. 

An  aspect  of  the  S-array  method  which  has  not  been 
discussed  here  is  the  information  it  contains  about  the 
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TABLE  2 

S- ARRAYS  FOR  A  TYPICAL  REALIZATION  IN  EXAMPLE  1 


ID  *  0 


m/n 

1 

2 

3 

4 

-6 

-.507 

0.000 

-.145 

0.000 

.491 

0.000 

-.393 

0.000 

-5 

1.286 

0.000 

-.125 

0.000 

.046 

0.000 

.015 

0.000 

-4 

-.510 

0.000 

-.112 

0.000 

-.042 

0.000 

-.094 

0.000 

-3 

1.261 

0.000 

-.100 

0.000 

.148 

0.000 

-.106 

0.000 

-2 

-.524 

0.000 

-.105 

0.000 

.533 

0.000 

1.318 

0.000 

-1 

1.346 

0.000 

-.084 

0.000 

-.658 

0.000 

-1.608 

0.000 

0 

-.574 

0.000 

.074 

0.000 

-.083 

0.000 

.079 

0.000 

1 

1 .100 

0.000 

.093 

0.000 

-.111 

0.000 

.222 

0.000 

2 

-.558 

0.000 

.089 

0.000 

-.312 

0.000 

-.078 

0.000 

3 

1.039 

0.000 

.102 

0.000 

-.030 

0.000 

-.053 

0.000 

4 

-.563 

0.000 

.111 

0.000 

.077 

0.000 

.044 

0.000 

5 

1.030 

0.000 

.131 

0.000 

-.176 

0.000 

.199 

0.000 

ID  -  .SO 

m/n _ 1 _ 2 _ 3 _ 4 


-6 

-1.493 

.000 

-.069 

.000 

-.044 

.000 

-.198 

.000 

-5 

-3.286 

.000 

-.130 

.000 

.168 

-.000 

-.162 

.000 

-4 

-1.490 

.000 

-.098 

.000 

.260 

-.000 

.236 

-.000 

-3 

-3.261 

.000 

-.135 

.000 

.093 

-.000 

.162 

-.000 

-2 

-1.476 

.000 

-.151 

.000 

-.431 

.000 

-.737 

.000 

-1 

-3.346 

.000 

-.210 

.000 

1.271 

-.000 

-3.103 

.000 

0 

-1.426 

.000 

.183 

.000 

-.160 

-.000 

.152 

.000 

1 

-3.100 

.000 

.134 

.000 

-.090 

-.000 

-.124 

-.000 

2 

-1.442 

.000 

.121 

.000 

.197 

.000 

.118 

.000 

3 

-3.039 

.000 

.089 

.000 

-.186 

-.000 

.133 

.000 

4 

-1.437 

.000 

.116 

.000 

-.280 

-.000 

-.465 

-.000 

5 

-3.030 

.000 

.062 

.000 

-.016 

-.000 

.101 

.000 

TABLE  2  (con’t) 


oi  -  .298 


m/n _ 1 


2 


3 


4 


-6 

-1.145 

.471 

1.927 

.586 

.906  -4.841 

-.543 

-1.883 

-5 

-1.672 

2.185 

1.932 

.636 

-2.540  .265 

3.085 

.021 

-4 

-1.144 

.469 

1.916 

.615 

-3.373  1.439 

1.912 

5.973 

-3 

-1.665 

2.161 

1.919 

.645 

-1.426  -1.353 

1.803 

4.932 

-2 

-1.140 

.455 

1.926 

.656 

3.149  -7.722 

18.318 

-4.375 

-1 

-1.690 

2.242 

1.930 

.705 

-10.334  10.906 

-17.091 

-33.340 

0 

-1.125 

.407 

1.737 

.438 

-1.873  -.258 

1.828 

.177 

1 

-1.617 

2.007 

1.739 

.479 

-1.517  -.845 

.450 

3.139 

2 

-1.130 

.423 

1.745 

.488 

.563  -4.110 

3.831 

-.102 

3 

-1.600 

1.949 

1.746 

.514 

-2.530  .706 

3.538 

-.238 

4 

-1.129 

.418 

1.734 

.496 

-3.593  2.311 

3.315 

8.209 

5 

-1.597 

1.941 

1.737 

.541 

-1.339  -1.152 

.990 

-.095 

S- ARRAYS  FOR  A  TYPICAL  REALIZATION  IN  EXAMPLE  2 
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possible  nonstationarity  of  the  observed  time  series  (see  Gray, 
Kelley,  and  Mclntire  (1978)).  An  analog  of  this  Important 
feature  of  the  S-array  method  is  not  possessed  by  automatic 
order  selection  techniques  such  as  the  AIC  criterion  of 
Akaike  (1969) .  The  behavior  of  complex-valued  S-arrays  under 
an  assumption  of  nonstationarity  is  an  area  for  future  research. 
Some  unforseen  application  of  these  arrays  to  the  nonstationary 
problem  may  well  exist. 
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